Goto

Collaborating Authors

 deep learning program


Improving Compositionality of Neural Networks by Decoding Representations to Inputs

Neural Information Processing Systems

In traditional software programs, it is easy to trace program logic from variables back to input, apply assertion statements to block erroneous behavior, and compose programs together. Although deep learning programs have demonstrated strong performance on novel applications, they sacrifice many of the functionalities of traditional software programs. With this as motivation, we take a modest first step towards improving deep learning programs by jointly training a generative model to constrain neural network activations to decode back to inputs. We call this design a Decodable Neural Network, or DecNN. Doing so enables a form of compositionality in neural networks, where one can recursively compose DecNN with itself to create an ensemble-like model with uncertainty. In our experiments, we demonstrate applications of this uncertainty to out-of-distribution detection, adversarial example detection, and calibration --- while matching standard neural networks in accuracy. We further explore this compositionality by combining DecNN with pretrained models, where we show promising results that neural networks can be regularized from using protected features.


Improving Compositionality of Neural Networks by Decoding Representations to Inputs

Neural Information Processing Systems

In traditional software programs, it is easy to trace program logic from variables back to input, apply assertion statements to block erroneous behavior, and compose programs together. Although deep learning programs have demonstrated strong performance on novel applications, they sacrifice many of the functionalities of traditional software programs. With this as motivation, we take a modest first step towards improving deep learning programs by jointly training a generative model to constrain neural network activations to "decode" back to inputs. We call this design a Decodable Neural Network, or DecNN. Doing so enables a form of compositionality in neural networks, where one can recursively compose DecNN with itself to create an ensemble-like model with uncertainty.


AI thought knee X-rays could tell if you drink beer and eat refried beans

Popular Science

Some artificial intelligence models are struggling to learn the old principle, "Correlation does not equal causation." And while that's not a reason to abandon AI tools, a recent study should remind programmers that even reliable versions of the technology are still prone to bouts of weirdness--like claiming knee X-rays can prove someone drinks beer or eats refried beans. Artificial intelligence models do much more than generate (occasionally accurate) text responses and (somewhat) realistic videos. Truly well-made tools are already helping medical researchers parse troves of datasets to discover new breakthroughs, accurately forecast weather patterns, and assess environmental conservation efforts. But according to a study published in the journal Scientific Reports, algorithmic "shortcut learning" continues to pose a problem of generating results that are simultaneously highly accurate and misinformed.


Understanding Memory Requirements for Deep Learning and Machine Learning

#artificialintelligence

Building a machine learning workstation can be difficult, not to mention choosing the right workstation with the proper machine learning memory requirements. There are a lot of moving parts based on the types of projects you plan to run. Understanding machine learning memory requirements is a critical part of the building process. Sometimes, though, it is easy to overlook. The average memory requirement is 16GB of RAM, but some applications require more memory.


How to Start Using Natural Language Processing With PyTorch

#artificialintelligence

Natural language processing (NLP) is continuing to grow in popularity, and necessity, as artificial intelligence and deep learning programs grow and thrive in the coming years. Natural language processing with PyTorch is the best bet to implement these programs. In this guide, we will address some of the obvious questions that may arise when starting to dive into natural language processing, but we will also engage with deeper questions and give you the right steps to get started working on your own NLP programs. Interested in a deep learning workstation that can handle NLP training? First and foremost, NLP is an applied science.


How to Start Using Natural Language Processing With PyTorch

#artificialintelligence

Natural language processing (NLP) is continuing to grow in popularity, and necessity, as artificial intelligence and deep learning programs grow and thrive in the coming years. Natural language processing with PyTorch is the best bet to implement these programs. In this guide, we will address some of the obvious questions that may arise when starting to dive into natural language processing, but we will also engage with deeper questions and give you the right steps to get started working on your own NLP programs. First and foremost, NLP is an applied science. It is a branch of engineering that blends artificial intelligence, computational linguistics, and computer science in order to "understand" natural language, i.e., spoken and written language.


Artificial Intelligence (AI) vs. Machine Learning (ML) vs. Deep Learning

#artificialintelligence

It is startling how technology has altered our lives in recent years. We mostly don't notice how much we rely on the use of artificial intelligence tools. Nevertheless, we rely on it in many spheres of our lives. Human existence is increasingly bound to technologies, that seem to be able to exercise judgments and operate independently. The question of whether computers can actually think still remains open.


Understanding Memory Requirements for Deep Learning and Machine Learning

#artificialintelligence

Building a machine learning workstation can be difficult, not to mention choosing the right workstation with the proper machine learning memory requirements. There are a lot of moving parts based on the types of projects you plan to run. Understanding machine learning memory requirements is a critical part of the building process. Sometimes, though, it is easy to overlook. The average memory requirement is 16GB of RAM, but some applications require more memory.


AI in sixty seconds

#artificialintelligence

The phrase artificial intelligence doesn't have any fixed meaning, for it was coined by Dartmouth professor John McCarthy in 1955 as a placeholder in a grant application. The best summary so far is by MIT's Marvin Minsky, a colleague of McCarthy's, who said the term stands for whatever is at the cutting edge of computer science. Commercial entities, such as software makers, will often use the term to mean whatever they want, simply to sound impressive by gaining the imprimatur of having "AI." Deep learning is a subset of a wider field of AI software called machine learning. Some believe AI has to have an element of learning because all intelligent entities exhibit an ability to learn.


Bored from Quarantine? Make Your Data Science Skills Recession-Proof

#artificialintelligence

Data science is one of the most well-payed jobs in the contemporary market. It is even considered as the hottest job of the 21st century. Data science has been a game-changer across every industry. With high-level digitization of processes, the generation of data is at peak and thus data science technology and tools are deployed to drive more productivity across organizations. This tech-field as a whole has a bunch of perks to provide including technologies for Big Data, Data Mining, Machine Learning, Data Analysis, and Data Analytics.